Staticlib hide internal symbols by cezarbbb · Pull Request #155338 · rust-lang/rust

cezarbbb · 2026-04-15T12:16:07Z

According to issue #104707, when building a staticlib, all Rust internal symbols — mangled symbols, #[rustc_std_internal_symbol] items, allocator shims, etc. — leak out of the static archive. In contrast, cdylib correctly exports only #[no_mangle] symbols via a linker version script.

-Zstaticlib-hide-internal-symbols directly post-processes ELF object files in the archive: parsing the SHT_SYMTAB sections and setting STV_HIDDEN visibility on any GLOBAL/WEAK defined symbol that is not in the exported symbol set, without changing the binding. This is an in-place modification (only writing the st_other byte per matching entry), with zero overhead.

Supported on ELF targets (Linux, BSD, etc.) and Apple targets (macOS, iOS, etc.). On unsupported targets (Windows), a warning is emitted and the flag has no effect.

Update: The rename counterpart (-Zstaticlib-rename-internal-symbols) is in #156950.

The test code are as follows:

1.a std rust staticlib:

use std::collections::HashMap;
use std::panic::{catch_unwind, AssertUnwindSafe};

#[no_mangle]
pub extern "C" fn my_add(a: i32, b: i32) -> i32 { a + b }

#[no_mangle]
pub extern "C" fn my_hash_lookup(key: u64) -> u64 {
    let mut map = HashMap::new();
    for i in 0..100u64 { map.insert(i, i.wrapping_mul(2654435761)); }
    *map.get(&key).unwrap_or(&0)
}

pub fn internal_reverse(s: &str) -> String { s.chars().rev().collect() }

#[no_mangle]
pub extern "C" fn my_format_number(n: i32) -> i32 {
    let s = format!("number: {}", n); s.len() as i32
}

#[no_mangle]
pub extern "C" fn my_safe_div(a: i32, b: i32) -> i32 {
    match catch_unwind(AssertUnwindSafe(|| {
        if b == 0 { panic!("division by zero!"); }
        a / b
    })) {
        Ok(result) => result,
        Err(_) => -1,
    }
}

#[no_mangle]
pub extern "C" fn my_uncaught_panic() { panic!("uncaught panic across FFI"); }

1.b downstream c program:

extern int my_add(int a, int b);
extern unsigned long my_hash_lookup(unsigned long key);
extern int my_format_number(int n);
extern int my_safe_div(int a, int b);
extern void my_uncaught_panic(void);

int main() {
    int failures = 0;
    if (my_add(10, 20) != 30) failures++;
    if (my_hash_lookup(5) != 5UL * 2654435761UL) failures++;
    if (my_format_number(42) != 10) failures++;
    if (my_safe_div(100, 5) != 20) failures++;
    if (my_safe_div(100, 0) != -1) failures++;
    pid_t pid = fork();
    if (pid == 0) { alarm(5); my_uncaught_panic(); _exit(0); }
    else { waitpid(pid, &status, 0); }
    return failures;
}

The test results with different compiler flags(which might cause binary size reduction) are as follows:
1.c result with -Zstaticlib-hide-internal-symbols

  settings                   OFF        ON  -Zsave     ALL    OFF.dynsym ON.dynsym 
  ------------------------------------------------------------------------
  default                 1.7M      1.5M  204K (12%)    1735       5    1730
  lto_thin                616K      584K  33K (5%)     246       5     241
  lto_fat                 525K      525K    0 (0%)       6       5       1
  opt_s                   1.7M      1.5M  204K (12%)    1735       5    1730
  opt_z                   1.7M      1.5M  204K (12%)    1735       5    1730
  lto_thin_z              602K      570K  32K (5%)     246       5     241
  lto_fat_z               514K      514K    0 (0%)       6       5       1
  full                    514K      514K    0 (0%)       6       5       1

1.d result with -Zstaticlib-hide-internal-symbols + -Zstaticlib-rename-internal-symbols

  settings                   OFF        ON  -Zsave     ALL    OFF.dynsym ON.dynsym 
  ------------------------------------------------------------------------
  default                 1.7M      1.5M  162K (9%)    1735       5    1730
  lto_thin                616K      599K  18K (2%)     246       5     241
  lto_fat                 525K      535K  -1% (-1%)       6       5       1
  opt_s                   1.7M      1.5M  162K (9%)    1735       5    1730
  opt_z                   1.7M      1.5M  162K (9%)    1735       5    1730
  lto_thin_z              602K      585K  18K (2%)     246       5     241
  lto_fat_z               514K      524K  -1% (-1%)       6       5       1
  full                    514K      523K  -1% (-1%)       6       5       1

2.a no_std rust staticlib

#![no_std]
#![feature(core_intrinsics)]

use core::panic::PanicInfo;

#[panic_handler]
fn panic(_info: &PanicInfo) -> ! { loop {} }

#[no_mangle]
pub extern "C" fn embedded_add(a: i32, b: i32) -> i32 { a.wrapping_add(b) }

#[no_mangle]
pub extern "C" fn embedded_checksum(data: *const u8, len: usize) -> u8 {
    if data.is_null() { return 0; }
    let slice = unsafe { core::slice::from_raw_parts(data, len) };
    let mut sum: u8 = 0;
    for &byte in slice { sum = sum.wrapping_add(byte); }
    sum
}

fn internal_helper() -> i32 { 42 }
#[no_mangle]
pub extern "C" fn call_internal() -> i32 { internal_helper() }

#[no_mangle]
pub extern "C" fn embedded_trigger_abort() { core::intrinsics::abort(); }

2.b downstream c program

extern int embedded_add(int a, int b);
extern unsigned char embedded_checksum(const unsigned char *data, unsigned long len);
extern int call_internal(void);
extern void embedded_trigger_abort(void);

int main() {
    int failures = 0;
    if (embedded_add(10, 20) != 30) failures++;
    unsigned char data[] = {1, 2, 3};
    if (embedded_checksum(data, 3) != 6) failures++;
    if (call_internal() != 42) failures++;
    pid_t pid = fork();
    if (pid == 0) { embedded_trigger_abort(); _exit(0); }
    else { waitpid(pid, &status, 0); }
    return failures;
}

The test results with different compiler flags(which might cause binary size reduction) are as follows:
2.c result with -Zstaticlib-hide-internal-symbols

  settings                   OFF        ON  -Zsave     ALL    OFF.dynsym ON.dynsym 
  ------------------------------------------------------------------------
  default                 485K      429K  56K (11%)     490       4     486
  lto_thin                180K      180K    0 (0%)       4       4       0
  lto_fat                 179K      179K    0 (0%)       4       4       0
  opt_s                   485K      429K  56K (11%)     490       4     486
  opt_z                   485K      429K  56K (11%)     490       4     486
  lto_thin_z              180K      180K    0 (0%)       4       4       0
  lto_fat_z               179K      179K    0 (0%)       4       4       0
  full                    179K      179K    0 (0%)       4       4       0

2.d result with -Zstaticlib-hide-internal-symbols + -Zstaticlib-rename-internal-symbols

  settings                   OFF        ON  -Zsave     ALL    OFF.dynsym ON.dynsym 
  ------------------------------------------------------------------------
  default                 485K      447K  39K (7%)     490       4     486
  lto_thin                180K      189K  -5% (-5%)       4       4       0
  lto_fat                 179K      189K  -5% (-5%)       4       4       0
  opt_s                   485K      448K  38K (7%)     490       4     486
  opt_z                   485K      448K  38K (7%)     490       4     486
  lto_thin_z              180K      189K  -5% (-5%)       4       4       0
  lto_fat_z               179K      189K  -5% (-5%)       4       4       0
  full                    179K      189K  -5% (-5%)       4       4       0

Test results show that this compiler option is beneficial for scenarios where LTO cannot be enabled.

r? @bjorn3 @petrochenkov

rustbot · 2026-04-15T12:16:14Z

r? @petrochenkov

rustbot has assigned @petrochenkov.
They will have a look at your PR within the next two weeks and either review your PR or reassign to another reviewer.

Use r? to explicitly pick a reviewer

Why was this reviewer chosen?

The reviewer was selected based on:

Owners of files modified in this PR: codegen, compiler
codegen, compiler expanded to 69 candidates
Random selection from 16 candidates

bjorn3 · 2026-04-15T12:24:07Z

This would also need to rename symbols to avoid conflicts between two rust staticlibs ending up getting linked together, right?

bjorn3 · 2026-04-15T12:27:57Z

The rust_eh_personality symbol is always kept visible to ensure .eh_frame unwinding works correctly for C consumers.

Why exactly is that the case? rust_eh_personality is actually the symbol that is most likely to cause conflicts as it is the only one whose name doesn't get mangled depending on the rustc version.

cezarbbb · 2026-04-15T12:42:34Z

This would also need to rename symbols to avoid conflicts between two rust staticlibs ending up getting linked together, right?

My primary goal right now is to reduce binary size, so I don't have immediate plans to implement symbol renaming. This means that linking multiple Rust staticlibs together can still result in multiple definition errors. Would you like me to address that in this PR as well? It seems feasible to implement — for example, by rehashing symbols and updating their references accordingly.

cezarbbb · 2026-04-15T12:50:03Z

The rust_eh_personality symbol is always kept visible to ensure .eh_frame unwinding works correctly for C consumers.

Why exactly is that the case? rust_eh_personality is actually the symbol that is most likely to cause conflicts as it is the only one whose name doesn't get mangled depending on the rustc version.

I previously assumed this symbol needed to remain externally visible to support scenarios requiring cross-language exception propagation. Do you think we should also set rust_eh_personality as hidden?

bjorn3 · 2026-04-15T12:51:20Z

If it isn't too hard it would be nice to do symbol renaming too. I think doing in-place modification isn't going to work for that though. Adding a unique suffix would require growing the size of the string table.

bjorn3 · 2026-04-15T12:52:52Z

I previously assumed this symbol needed to remain externally visible to support scenarios requiring cross-language exception propagation. Do you think we should also set rust_eh_personality as hidden?

rust_eh_personality is only meant to be referenced by the .eh_frame section of rust object files. The only reason it's name isn't mangled is because LLVM hard codes the name to determine the exception table format to emit.

cezarbbb · 2026-04-15T12:58:28Z

If it isn't too hard it would be nice to do symbol renaming too. I think doing in-place modification isn't going to work for that though. Adding a unique suffix would require growing the size of the string table.

Got it. I will first fix the rust_eh_personality issue, and then try to implement symbol renaming.

SparrowLii · 2026-04-16T03:55:52Z

@bors delegate=try

rust-bors · 2026-04-16T03:55:55Z

✌️ @cezarbbb, you can now perform try builds on this pull request!

You can now post @bors try to start a try build.

cezarbbb · 2026-04-16T04:38:38Z

@bors try

`-Zstaticlib-hide-internal-symbols`: Hide non-exported internal symbols from staticlibs

rust-bors · 2026-04-16T06:48:19Z

☀️ Try build successful (CI)
Build commit: a9431d3 (a9431d37da1d0346038257cec9d94f2783997621, parent: e8e4541ff19649d95afab52fdde2c2eaa6829965)

cezarbbb · 2026-04-16T06:50:43Z

@bors try jobs=x86_64-*

petrochenkov · 2026-05-27T11:13:59Z

Enough for now.
@rustbot author

rustbot · 2026-05-27T11:14:04Z

Reminder, once the PR becomes ready for a review, use @rustbot ready.

cezarbbb · 2026-05-30T09:55:31Z

@rustbot ready

- Symbol collection directly utilizes `exported_symbols` for reverse matching - Using RmetaLink to accurately track archive content instead of only checking `.rcgu.o`

rustbot · 2026-06-01T01:36:20Z

This PR was rebased onto a different main commit. Here's a range-diff highlighting what actually changed.

Rebasing is a normal part of keeping PRs up to date, so no action is needed—this note is just to help reviewers.

petrochenkov · 2026-06-01T15:38:29Z

+            continue;
+        }
+        let Ok(name_bytes) = sym.name(endian, strings) else { continue };
+        let Ok(name) = std::str::from_utf8(name_bytes) else { continue };


Suggested change

let Ok(name) = std::str::from_utf8(name_bytes) else { continue };

let Ok(name) = str::from_utf8(name_bytes) else { continue };

View changes since the review

Not actually applied.

petrochenkov · 2026-06-01T15:50:44Z

Most of the ELF comments apply to Mach-O too, as usual.
@rustbot author

petrochenkov · 2026-06-01T16:42:51Z

#157263 is a better alternative for the is_rust_object: bool flag.
@rustbot blocked

cezarbbb · 2026-06-03T09:46:41Z

Seems like rustdoc-gui test failed, unrelated to this change.

petrochenkov · 2026-06-03T09:51:45Z

I'll do one final review pass when #157263 lands and this PR is updated for it, but otherwise this is mostly ready for merging.

cezarbbb · 2026-06-03T09:57:47Z

I'll do one final review pass when #157263 lands and this PR is updated for it, but otherwise this is mostly ready for merging.

Thank you so much for your valuable review! I will be ready to adapt #157263!

rustbot assigned petrochenkov Apr 15, 2026

This comment has been minimized.

Sign in to view

rustbot assigned bjorn3 and unassigned petrochenkov Apr 15, 2026

cezarbbb force-pushed the staticlib-symbol-hygiene branch from ff707ad to 7ac49d1 Compare April 15, 2026 12:35

This comment has been minimized.

Sign in to view

cezarbbb force-pushed the staticlib-symbol-hygiene branch from 5e1c3a1 to c7d4e98 Compare April 16, 2026 03:27

This comment has been minimized.

Sign in to view

rust-bors Bot pushed a commit that referenced this pull request Apr 16, 2026

Auto merge of #155338 - cezarbbb:staticlib-symbol-hygiene, r=<try>

a9431d3

`-Zstaticlib-hide-internal-symbols`: Hide non-exported internal symbols from staticlibs

This comment has been minimized.

Sign in to view

petrochenkov reviewed May 26, 2026

View reviewed changes

cezarbbb force-pushed the staticlib-symbol-hygiene branch from 54a7c4c to 303ab30 Compare May 27, 2026 03:17

bjorn3 reviewed May 27, 2026

View reviewed changes

Comment thread compiler/rustc_codegen_ssa/src/back/archive.rs Outdated

petrochenkov reviewed May 27, 2026

View reviewed changes

rustbot added S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels May 27, 2026

rustbot added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels May 30, 2026

This comment has been minimized.

Sign in to view

cezarbbb added 2 commits June 1, 2026 09:02

add -Zstaticlib-hide-internal-symbols

6023964

- Use objects instead of manually resolving library files

a9c6743

- Symbol collection directly utilizes `exported_symbols` for reverse matching - Using RmetaLink to accurately track archive content instead of only checking `.rcgu.o`

cezarbbb force-pushed the staticlib-symbol-hygiene branch from dca392e to a9c6743 Compare June 1, 2026 01:36

petrochenkov reviewed Jun 1, 2026

View reviewed changes

rustbot added S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Jun 1, 2026

petrochenkov mentioned this pull request Jun 1, 2026

rustc_codegen_ssa: Refactor ArchiveEntry to include entry kind #157263

Open

rustbot added S-blocked Status: Blocked on something else such as an RFC or other implementation work. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels Jun 1, 2026

This comment has been minimized.

Sign in to view

Modified based on reviews

c6e0c17

cezarbbb force-pushed the staticlib-symbol-hygiene branch from b9aaaaf to c6e0c17 Compare June 3, 2026 09:55

	let Ok(name) = std::str::from_utf8(name_bytes) else { continue };
	let Ok(name) = str::from_utf8(name_bytes) else { continue };

Uh oh!

Conversation

cezarbbb commented Apr 15, 2026 • edited by rustbot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

rustbot commented Apr 15, 2026

Uh oh!

This comment has been minimized.

bjorn3 commented Apr 15, 2026

Uh oh!

bjorn3 commented Apr 15, 2026

Uh oh!

This comment has been minimized.

This comment has been minimized.

cezarbbb commented Apr 15, 2026

Uh oh!

cezarbbb commented Apr 15, 2026

Uh oh!

bjorn3 commented Apr 15, 2026

Uh oh!

bjorn3 commented Apr 15, 2026

Uh oh!

cezarbbb commented Apr 15, 2026

Uh oh!

This comment has been minimized.

This comment has been minimized.

SparrowLii commented Apr 16, 2026

Uh oh!

rust-bors Bot commented Apr 16, 2026

Uh oh!

cezarbbb commented Apr 16, 2026

Uh oh!

This comment has been minimized.

rust-bors Bot commented Apr 16, 2026

Uh oh!

cezarbbb commented Apr 16, 2026

Uh oh!

This comment has been minimized.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

petrochenkov commented May 27, 2026

Uh oh!

rustbot commented May 27, 2026

Uh oh!

cezarbbb commented May 30, 2026

Uh oh!

This comment has been minimized.

rustbot commented Jun 1, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

petrochenkov Jun 1, 2026 • edited by rustbot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

cezarbbb Jun 3, 2026

Choose a reason for hiding this comment

cezarbbb commented Apr 15, 2026 •

edited by rustbot

Loading

petrochenkov Jun 1, 2026 •

edited by rustbot

Loading

cezarbbb commented Jun 3, 2026 •

edited

Loading